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ABSTRACT 



The present invention pertains to a method and device for 
recognizing distribution data on postal packets, small pack- 
ages or journals during the automatic mail processing, 
especially to systems by which the automatic handwritten 
adress recognition process is supplemented and improved by 
video coding. The distribution data are written on various 
backgrounds, including pattern backgrounds. After a first 
unsuccessful optical character recognition attempt, the com- 
plete surface of the postal packet is displayed with a grid on 
a videocoding-screen. Once a picture segment has been 
selected which contains a larger part of the distribution data, 
the operator submits an image portion containing said pic- 
ture segment and the adjacent areas to a new optical char- 
acter assessment, while making sure that all the data area is 
included in the image portion. If the second optical character 
recognition attempt does not succeed, the image portion is 
reoriented as many limes as required for the final video 
coding to appear on the screen. 
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METHOD AND DEVICE FOR RECOGNIZING once. This method is not effective for individual mail items, 

DISTRIBUTION DATA ON POSTAL and cannot be performed for parcels. 

PACKETS The use of computer displays to support the automatic 

ROI search is described in Pattern Recognition, Volume 23, 
5 1990, pp. 347-362, "Preprocessing and Presorting of Items 

BACKGROUND OF THE INVENTION for Automatic Sorting Using OCR/' and EP 0 589 119. 

Field of the Invention following disadvantages are associated with this 

practice: 

The invention relates to the recognition of distribution special input means that do not interrupt keyboard entry 

information on mail items. In the broadest sense, the ioven- are necessary; 

tion relates to the field of automatic mail-item processing, precise location information about the ROI is necessary; 

and particularly to systems in which an automatic OCR , . ^ • j- i i . 

. . ^ J. *i_ J • 1 * J J • ju large unages or periodicals or parcels cannot be processed 

address-reading method is supplemented and improved by . ^ I . j- i 

. , " on a standard computer display; 

video coding. r r 

15 there is no integration of the ROI determination into the 

Technical Background complete address-reading solution, including OCR and 

video coding. 

Optical character recognition (OCR) is an estabUshed There is therefore a need for a solution for fast and 

image -processing method in which images are recorded with reliable determination of regions of interest, particularly 

an appropriate resolution, and machine-readable characters 20 address regions, with the aid of video coding in large video 

(letters, numbers) are ascertained from the images. This images of mail-item surfaces having different backgrounds, 

method is widely used in, for example, text processing, form the solution permitting an online processing of the items. No 

reading and automatic sorting of mail items. inp^it means should be necessary in addition to the keyboard 

Systems for automatically reading addresses (OCR) are for assuring fast video coding, 

well-known in the field of letter processing, and are ^5 

described in. for example, DE 195 31 392, Modern OCR SUMMARY OF THE INVENTION 

letter-sorting systems can attain processing rates of ten ^^^^ ^^^^ distribution information that is located 

letters per second, or 36,000 letters per hour, and higher. ^ y^^^^ ^^^^^ ^^^^^^ backgrounds, it is not possible 

However, the recogmtion reliabibty varies greatly xsith the automaticaUy find and exclusively evaluate the informa- 

writing style and the overall quality of the address inforraa- 30 ^.^^^^^^ intervention of a video coder. The disclosed 

tion located on the letter surface. In the event of successful embodiment of the invention has, for the first time, com- 

recognilion, the relevant letter can be provided with a ^ined video coding with the automatic OCR evaluation 

machine-readable barcode. Hiis barcode permits further process, including the search for the regions (ROI) contain* 

mechanical processing up to an arbitrary sorUng order. In ^^^^^^ information, especially with the zoom func- 

particular, the use of barcodes permits a sortmg of mail 35 tion initiated by the operator and the processing and display 

items, such as long letters or small parcels, up to the sorting j^e zoomed image section, all with Uttle input effort, 

level of the mail delivery, at which the delivery person sorts ^^^^^ processing extremely fast. The multi-stage 

the items according to their distribution sequences. video-coding and OCR process has proven particularly 

The need for address reading also exists for larger parcels, effective, thus penmitting an online processing of the mail 

newspapers and periodicals. ^ items. 

Although the above-described address reading is a tried- Moreover, this solution requires no special, costly moni- 

and-true technique, its use for the sizeable number of tors or workstations. 

periodicals, newspaper^, small packages and parcels that are y^e invention is described in detail below by way of an 

mailed is limited by difiBculties m automatically and reliably embodiment 

locating and reading the address region, also referred to as tu ' u 

the ROI (Region of Interest). The problems associated with ' drawmg shows m: 

automatic ROI determination through image -processing BRIEF DESCRIPTION OF THE FIGURES 
methods occur particularly with flat mail items such as 

periodicals, newspapers, books and parcels because of back- FIG. 1 a schematic representation of a device for execut- 
ground interferences or interfering surfaces. This is partial- ing the method of an embodiment of the invention; 
larly due to the fact that different address labels are applied FIG. 2 a flow chart for the method; and 
to a background that contains text (newspapers) or graphics FIG. 3 a monitor layout for the video coding, 
(periodicals, magazines, books). Errors in ROI determina- 
tion are critical, because they render the remaining auto- DETAILED DESCRIPTION OF THE 
matic process impossible. PREFERRED EMBODIMENTS 

Although complex image-processing algorithms for ROI According to the figure, an OCR parcel or small-package/ 

determination exist, various manual actions are necessary periodical sorter 100 comprises a feed 110, which succes- 

for pcrfonming the ROI search according to the current state sively retrieves the mail items from a magazine 111 and 

of the technology. 60 transports them to a high-resolution video scanner 120. The 

In accordance with DE 394 30 73, a letter is placed on a items are then transported in a delay segment 121. During 

digitization tray and fixed against stops. A marking pen is the transport, the required address information of the item 

used to enter scanning coordinates for the address block of images 122, which was obtained by the video scanner 120, 

interest; the coordinates of the corner points of the address is evaluated in the OCR processor 130. In the case of a 

block are transferred to the system's control computer by 6S complete evaluation, a barcode printer 150 is actuated, and 

way of an interface. This method can be used to process the item is imprinted with a corresponding barcode for 

mass mailings, because the coordinates need only be entered subsequent sorting in sorting compartments 160. The OCR 
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processor 130 comprises one or a plurality of microproces- 
sors 131 having associated memories 132 for storing i mages 
122 of the items. ^^g|gg^gja^&sai||toh^T|^5pISB^^i^ 

Sppu^ 



FIG. 3 illustrates the monitor layout. 
The entire surface of the mail item containing the address 
information is displayed on the monitor. A grid and 
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The device also includes an image controller 170 and a 
plurality of video-coding stations 200, which are connected 
to the image controller 170 directly or by a local network 
(LAN) 171. If the OCR evaluation of an image was 
unsuccessful, this image is transferred from the OCR pro- 
cessor 130 to the image controller 170, which controls a TID 
barcode printer 151, on the one hand and, on the other hand, 
transmits the corresponding image to one of the video- 
coding stations 200. The TID barcode printer 151 applies an 
identification code TID to the corresponding item, which 
permits the evaluated address information to be linked to the 
physical item at a later time. The images are evaluated 
ofQine in this case, although an onhne evaluation with video 
coding is preferably performed with a sufficient delay time. 
In the latter case, the TID can also be applied to the items at 
a later time, i.e., when the video coding has not resulted in 
a complete evaluation within a certain, predetermined time. 

The image controller 170 ensures that the method is 25 
executed properly, including the data exchange between the 
OCR processor 130 and the video-coding stations 200 and 
the superposing of the images on a grid. 

For executing the method, which is described in detail 
below, the image controller 170 is embodied such that 
address information, that was not completely evaluated in 
the video coding with the use of the results of the video 
coding in the OCR processor is supplied to a further auto- 
matic address evaluation. 



^^l|S^^info'^^-~5 i^^^ segments. The operator selects the segment con- 
taining the largest portion of the distribution information to 
be evaluated (recipient's name and address), in this case 
segment number 1< If this region was assessed as an address) 
labeljn the previous^t)dR process, it is optically enhanced 
in^the display. The operator enters an as confirmation. Had 
the search of the re ^on of interest in the automatic OCR 
^]valvatipn.been unsuccessfiil (no optical enhancement of the 
region)^ the operator would enter the number of the segment, 
in -this example the number 1. In^ the-repeated- QCRO 



e^luatio^acorrespontog image s 
secfionTcontains such-large -marginaFTegibhs next ~to"the 
Jseginent~of "interest that it encompasses the entire- address 

Oabelr-' 



30 



35 



» The procedure is illustrated by the flow chart in FIG. 2. 

First, an automatic OCR recognition process 300 is 
effected in the recorded image of the item surface containing 
the distribution information. The steps are performed as 



follows: ^^^a^sear^^^g^heir^ioni^^^^Khf 
^intetest^^R ^j-ingl S'di^ 
f^joyiig?^^5^sM*$careh«gfag^ 
r€igogyaitdiDn?p3£E^^\^hsthe^ 

ciia^g^re»ati3J^fiHiw|?lgU^ii?f5^ no 
distribution information is ascertained and unambiguously 45 
recognized in the image 310, the image of the entire surface 
is superposed with a grid network on the monitor of a 
video-coding station 320. This grid divides the image into 
numerous segmentsJ^^g^^Stislritl^^^^ 
sp^^g^pnii^nQMt^eBf§?i^^ffiSSgrag^^^ 

^^ili^aslMggpMiot^^b^?lM!i^ 

^^iTc'^a'Beiy 330. To ensureThat aU of the distribution 
information is registered, not only is the entered image 
segment, but surrounding regions, evaluated (340) in a new 
OCR recognition attempt 350. In this new recognition 
attempt, it is also determined whether a region of interest 
(ROI) is present 350 and, if one is, the actual recognition 
process 370 is performed for the region ROI. If the infor- 
mation recognition is successful, the process is concluded. If 
the information recognition is unsuccessful in this second 60 
attempt, the evaluated region is displayed 380, 385 on the 
monitor of the video-coding station. If the region of interest 
ROI has already been determined, this region is directly 
displayed on the monitor 385 with a corrected orientation; if 
the orientation is inconect, the operator must manually 65 
rotate the image 390, The region of interest is then video- 
coded 400. 



What is claimed is: 

1. A method of recognizing distribution infonmation on 
20 mail items, in which an image of a surface of each mail item 

containing the distribution information is obtained and 
evaluated by means of automatic OCR recognition methods 
and video coding, the method comprising: 

a) performing a first automatic search of a region of 
interest (ROI), the ROI being a region of the mail item 
containing the distribution information, the search 
including determining an orientation of the distribution 
information and performing a first automatic OCR 
recognition; 

b) displaying an entire image of the surface containing the 
distribution information on a video-coder monitor if the 
first automatic OCR recognition yields an ambiguous 
result; 

c) dividing the image on the video-coder monitor into 
image segments with a grid; 

d) manually selecting the image segment from the dis- 
played image that contains a portion of the ROI via a 
single keystroke; 

e) performing a second automatic search of a new region 
containing the distribution information, where the new 
region is designated by the manually selected image 
segment and includes marginal regions of segments 
adjacent to the manually selected image segment such 
that the new region encompasses the distribution infor- 
mation; and 

f) performing a second automatic OCR evaluation of the 
new region containing the distribution information. 

2. The method according to claim 1, further comprising, 
representing only the new region on an enlarged scale on the 

n^o video-coding monitor such that the distribution information 
is oriented with a correct orientation and position based on 
information from the second OCR evaluation, and no video 
coding is performed, if the new region containing the 
disuibution information is unambiguously evaluated with 
the second automatic OCR evaluation. 

3. The method according to claim 1, wherein the single 
keystroke is effected in a video-coding station. 

4. The method according to claim 1, further comprising 
visually enhancing the region containing the distribution 
information, which was ascertained in the first automatic 
search, on the monitor. 

5. The method according to claim 1, further comprising: 
determining if the results of the second automatic OCR 

evaluation are ambiguous; and 
performing a third automatic OCR evaluation, which 
employs the results of the video coding if the results of 
the second OCR evaluation are ambiguous. 



55 
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6. The method according to claim 5, further comprising: 
determining if the results of the third automatic OCR 

evaluation are ambiguous; and 
performing a fourth automatic OCR evaluation, which 
employs the results of the third automatic OCR evalu- 
ation if the results of the third automatic OCR evalu- 
ation are ambiguous. 

7. A device for recognizing distribution information on 
mail items, comprising 

means for obtaining images of mail items; 

means for automatic OCR evaluation of distribution infor- 
mation contained in the images of the mail items, 
including means for performing a search of distribution 
information; j5 

at least one video-coding station that includes a monitor 
and an input device for video coding by manually 
selecting an image segment; and 
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an image controller receiving the images of mail items, 
generating a grid and a superposed display with the 
image of the mail item containing the distribution 
information on the monitor of the video-coding station, 
generating an enlarged image section, comprising the 
selected image segment and border regions to all adja- 
cent segments, and 

if the evaluation is ambiguous, representing the enlarged 
image section on the monitor of the video-coding 
station with the distribution information corrected in 
terms of orientation and position and transferring the 
enlarged image section and the distribution information 
that was ambiguously evaluated by the video coding to 
the means for automatic OCR evaluation for a second 
evaluation based on the enlarged image section. 
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